🕷️️ Job Radar • SCRAPING

freelancer.com 🟡 2026-05-23

🔹 Hybrid API Integration and Web Scraping Pipeline
👤 Client: 🇷🇸 Belgrade, Serbia Member since 2026-05-05
💰 Price: $297 Average bid
🚩 Problem: Lack of unified data feeds from third-party sources requiring a combined API and scraping fallback system for real-time display.
📦 Existing: MySQL database

Specifications:

[Target]: REST and GraphQL endpoints
[Target]: Third-party web pages
[Method]: Headless scraping
[Method]: Proxy rotation
[Method]: Anti-bot evasion
[Method]: Rate limit management
[Stack]: Python
[Stack]: Scrapy / BeautifulSoup
[Stack]: MySQL
[Format]: Normalized JSON
[Security]: Authentication keys and tokens

Workflow:

1. API layer connection and data extraction via REST/GraphQL.
2. Scraper fallback execution for unavailable endpoints.
3. Data normalization and mapping to unified structure.
4. MySQL database write and content refresh trigger.
5. Job scheduling via cron/queue with failure alerting.